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(54) Video game apparatus, method and recording medium storing program for controlling 
movement of simulated camera in video game 



(57) A 3-dimensional video game apparatus com- 
prises display 40 for displaying an image; image- 
processing means 16 for creating a 3-dimensional im- 
age from the viewpoint of a simulated camera and dis- 
playing that image on a display screen; and game con- 
troller 14 which conducts the game in response to reac- 
tions of the player, responsive to images displayed on 
display 40. The game apparatus further comprises cam- 
era unit 42 which can be arranged in such an orientation 
that its field of view is the play area in front of the display 
screen, and which periodically captures images of the 
play area in the state thus arranged; a position recog- 
nizing part which detects the player's head from the cap- 
tured image, and detects the two-dimensional move- 
ment of the detected head position; and viewpoint 
change processor which moves the viewpoint of said 
simulated camera in conjunction with the change direc- 
tion and change amount of the position of the detected 
marked region. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to a video game 
control technique whereby game images from the view- 
point of a simulated camera, for example a 3-dimension- 
al images, are created and displayed on a display 
screen and, while varying the viewpoint of a simulated 
camera, the game is conducted by receiving reactions 
from a player who is responding to images displayed on 
the above-mentioned display. 

2. Description of the Related Art 

[0002] Coin-operated game machines, wherein a 
camera is affixed to an appropriate location on the game 
cabinet and this camera captures the image of a player, 
who is playing in front of a game scene displayed on the 
monitor, are already known. In such game machines, 
the player's movement is confirmed by image capture 
of a special detectable object mounted on the player 
(and suitable for being image-captured by the camera). 
With these game machines, movement of the human 
body is detected from the image of the detectable object 
which is image-captured by the camera, and the game 
proceeds, developing in response to that movement. In 
addition, coin -operated games are known in which one 
ultrasound transmitter and two ultrasound receivers are 
mounted on top of the player's head, an ultrasound 
pulse transmitted by the transmitter is reflected by the 
player's head and the head position is calculated from 
the propagation times of the ultrasound pulses received 
by each of the two receivers and the time difference be- 
tween them. In these games, the viewpoint of a simu- 
lated camera, which is the reference for generating sim- 
ulated 3-dimensional game scenes, is linked to the cal- 
culated head position. 

[0003] In contrast, unlike the case of coin operated 
games, it is difficult to achieve home video games which 
provide game scenes having a feeling of realism, 
through linking the viewpoint of the simulated camera to 
the player's movement. For example, a fixed and invar- 
iable play area cannot be assured, as it can in the case 
of coin-operated games, so there is the problem of 
processing the varied background images included in 
the captured image according to place and time. Fur- 
thermore, there is a limit to how strongly a player can 
be urged to buy the special "detectable object" which, 
as mentioned above, is easily detectable in a captured 
image. 

SUMMARY OF THE INVENTION 

[0004] With the foregoing in view, it is an object of the 
present invention to provide a video game apparatus 



wherein an image capture means is positioned in the 
desired position with its orientation such that its field of 
view is the play area in front of the display screen and 
wherein the viewpoint of above-mentioned simulated 

5 camera is moved, linked to the change direction and 
change amount of the marked region based on the cap- 
tured images. It is also an object of the present invention 
to provide a method and program for controlling move- 
ment of the simulated camera viewpoint in a video 

10 game. 

[0005] The one aspect of the present invention relates 
to a video game apparatus comprising: a display for dis- 
playing images; a display control means for creating 
game images as seen from a simulated camera view- 
's point and displaying said images on the screen of the 
display; and fx game control part for conducting the 
game in response to reactions of a player responsive to 
the images displayed on the display; an image capture 
means which can be arranged in such an orientation that 
20 its field of view is the play area in front of the display 
screen, and which periodically captures an image of the 
play area in the state thus arranged; a position detecting 
means for detecting from the captured images the po- 
sition of a player's marked region; a movement detecting 
25 means for detecting two-dimensional movement of the 
position of the marked region thus detected; and a view- 
point changing means for moving the simulated camera 
viewpoint, in accordance with the change direction and 
change amount of the position of the detected marked 
30 region. 

[0006] These and other objects, features and advan- 
tages of the present invention will become more appar- 
ent upon reading the following detailed description 
along with the accompanied drawings. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0007] 

40 Fig. 1 is a diagram showing a player using a game 
apparatus according to an embodiment of the 
present invention and enjoying a gun-shooting 
game; 

Fig. 2 is a diagram showing the hardware configu- 

45 ration of the game apparatus; 

Fig. 3 is a diagram showing the software configura- 
tion of the microprocessor of the game apparatus; 
Figs 4A to 4D consist of several diagrams which il- 
lustrate an example of a game scene showing the 

so case of a player moving in an up-down direction; 

Figs. 5A to 5D consist of several diagrams which 
illustrate an example of a game scene showing the 
case of a player moving in a transverse direction; 
Fig. 6 is a diagram showing an example of a title 

55 screen (start screen); 

Fig. 7 is a flow diagram describing title screen dis- 
play processing; 

Fig. 8 is a diagram illustrating an example of the 
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"player standing position guide" image included in 
the title screen; 

Fig. 9 is a diagram showing a variation of the "player 
standing position guide" image included in the title 

screen; 5 
Fig. 10 is a diagram describing processing of the 

player image; 

Fig. 11 is a diagram describing filter processing re- 
lated to the recognized position; 
Figs. 1 2A to 1 2D are diagrams showing a series of 10 
player images; 

Fig. 13 is a diagram showing the differential image 
between the newest image and an averaged image; 
Fig. 14 is a diagram showing the results of extract- 
ing the previously recognized position neighbor- 
hood from the image shown in Fig. 13; 
Fig. 15 is a diagram showing the differential image 
between the newest image and an averaged image 
in the case that player movement is small; 
Fig. 1 6 is a diagram showing the results of extract- 20 
ing the previously recognized position neighbor- 
hood from the image shown in Fig. 15; 
Fig. 17 is a diagram showing the differential image 
between the newest image and the immediately 
preceding image; 25 
Fig. 1 8 is a diagram showing the result of extracting 
the previously recognized position neighborhood 
from the image shown in Fig. 17; 
Fig. 19 is a diagram showing the differential image 
between the newest image and the immediately 30 
preceding image, in the case that the previously 
recognized position is separated from the newest 
player image and the immediately preceding player 
image; 

Fig. 20 is a figure showing the result of extracting, 35 
from the image shown in Fig. 19, a position closer 
to the player from the previously recognized posi- 
tion; and 

Figs. 21 Aand21 Bare diagrams showing the mem- 
ory content of the "recognized position" buffer. *o 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0008] Fig. 1 is a perspective view illustrating the sit- 
uation of a player using a game apparatus according to 
an embodiment of the present invention and playing a 
game. As shown in the same figure, the game apparatus 
is configured including home-use TV receiver 40 as a 
display, camera unit 42 as an image capturing means, so 
home video game machine 46, and gun controller 48, 
and is a device for achieving a gun shooting game. 
[0009] Home-use TV receiver 40 and home video 
game machine 46 are, for example, mounted on cabinet 
44, and camera unit 42 in the present embodiment is ss 
mounted on top of home-use TV receiver 40. Camera 
unit 42 is a digital camera which captures images of the 
player's stance in real time and is connected to home- 



use game machine 46 by a cable. The digital camera 
has photoacceptor elements, such as charge coupled 
devices (CCD's), positioned in a2-dimensional arrange- 
ment at the imaging position on the optical axis of a pho- 
tographic lens and, with the proper exposure time, it acts 
as a device which captures optical images of the objects 
in the field of view (the player). 

[0010] Home-use game machine 46 is connected to 
home-use TV receiver 40 which displays the game 
scenes generated by home-use game machine 46 and 
outputs the game music and game sound effects. In ad- 
dition, it is arranged that, when performing normalizing 
processing of the standing position, the image of the 
player which was image-captured is provided in real 
time to home-use game machine 46. Gun controller 48 
is a pistol-shaped game controller and is connected to 
the controller connection terminal of home-use game 
machine 46 by a cable. Player P holds gun controller 48 
in his hand and when he points it at home-use TV re- 
ceiver 40, its barrel direction is inputted into home-use 
game machine 46. In addition, gun controller 48 is pro- 
vided with a trigger, and a signal indicating trigger status 
(trigger pulled or nor not) is inputted into home-use 
game machine 46. 

[0011] With family-use video game machine 46, a 
3-dimensional game space (virtual 3-dimensional 
space) is built in memory and it is arranged that the ap- 
pearance of viewing the 3-dimensional space from the 
viewpoint of a simulated camera located at a specified 
spatial position is displayed on home-use TV receiver 
40. At this time, home-use game machine 46 confirms 
the position of player P*s head from the player image 
and performs viewpoint change processing to link 
above-mentioned viewpoint position to player's head 
position. As a result, when player P moves his body in 
front of camera unit 42, the game scene displayed on 
home-use TV receiver 40 changes in response to that, 
and player P can get a sense just as though he himself 
had entered into the 3-dimensional game space (a 
sense of "being there.") In this way, with home-use 
game machine 46, a game is achieved wherein player 
P, using gun controller 48, shoots the enemy characters 
who appear in the 3-dimensional game space and play- 
er P, by moving his body (specifically his head position), 
can dodge the incoming attack (shots) of the enemy 
characters. 

[0012] Fig. 2 is a diagram showing the hardware con- 
figuration of game apparatus 10. As shown in that dia- 
gram, game apparatus 10 is configured by mounting 
DVD (Digital Versatile Disk, trademark) unit 25, which 
serves as an information storage medium, on home-use 
game machine 46, which is connected to monitor 1 8 and 
speaker 22, which are part of home-use TV receiver 40. 
Here, for supplying game. programs and game data to 
home-use game machine 46, DVD unit 25 is used, but 
any other kind of information storage medium, such as 
CD-ROM (Compact Disk - Read Only Memory, trade- 
mark) or ROM (Read Only Memory) card, etc. could be 
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used. In addition, it is possible to supply game programs 
and game data to home-use game machine 46 from a 
distant location, via a data communication network, 
such as the Internet. 

[0013] Home-use game machine 46 is configured in- 
cluding microprocessor 14, image processor 16, main 
memory 26, input/output processor 30, peripheral de- 
vice interface 31 , audio processor 20, and DVD play- 
back part 24. Microprocessor 14, image processor 16, 
main memory 26, input/output processor 30, and periph- 
eral device interface 31 are connected by means of bus 
1 2 which enables mutual data communication. Gun con- 
troller 48, audio processor 20, and DVD playback part 
24 are connected to input/output processor 30. In addi- 
tion, camera unit 42 is connected to peripheral device 
interface 31. The various elements which make up 
home-use game machine 46 are contained within a cab- 
inet. Here, as monitor 18, home-use TV receiver 40 is 
used, and as speaker 22, its internal speaker is used. 
[0014] Microprocessor 1 4 controls each part of home- 
use game machine 46 based on an operating system 
stored in a ROM (not shown in the figure) and the game 
program read out from DVD 25. Bus 12 is for the ex- 
change of addresses and data between the various 
parts of home-use game machine 46. In addition, game 
programs and game data read out from DVD 25 are writ- 
ten into main memory 26 as necessary. Image proces- 
sor 16 is configured including VRAM (Video Random 
Access Memory) and, receiving image data sent from 
microprocessor 1 4, plots game scenes in VRAM. Image 
processor 16 also converts that content into video sig- 
nals and outputs them to monitor 1 8. 
[0015] Image processor 16 calculates the coordinate 
positions, etc. of each character (enemy characters, 
physical "characters" such as the various buildings po- 
sitioned in the game space, etc.) viewed from the view- 
point of the simulated camera within the simulated 3-di- 
mensional space. From the calculated coordinate posi- 
tions in the simulated 3-dimensional space, image proc- 
essor 16 also performs the calculations for converting 
to coordinate positions in 2-dimensional space and per- 
forms positioning processing of the polygons which con- 
stitute the images to be plotted in the display buffer of 
main memory 26. In addition, image processor 16 per- 
forms texture mapping in regard to each polygon. As in- 
formation on the viewpoint of the simulated camera for 
calculation of character coordinate positions, position 
information on the player's marked region for example 
his head, is transmitted from position recognizing part 
71 which will be explained later. Consequently, the view- 
point of the simulated camera substantially matches the 
eye of the player, and in this embodiment, a character 
corresponding to the player does not appear on the 
monitor screen. 

[0016] Input/output processor30 is an interface for re- 
laying data communications between gun controller 48, 
audio processor 20, DVD playback part 24, and micro- 
processor 14. As shown in Fig. 1 , gun controller 48 is a 
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pistol-shaped game controller and is used for inputting 
into home-use game machine 46 the trigger status and 
barrel (muzzle) direction (specifically, the position on the 
screen of home-use TV receiver 40 at which the barrel 

5 is pointed). For gun controller 48, a commonly known 
configuration can be used, for example. In other words, 
when player P pulls the trigger of gun controller 48. that 
information (trigger signal) is inputted into home-use 
game machine 46 from the controller terminal. Then, in 

10 home-use game machine 46, when that trigger signal is 
inputted, by means of the game program, for example, 
a scene of a specific color (for example, white) is dis- 
played for just one frame, and as a result, a spot is 
scanned on the screen of home-use TV receiver 40. By 

is providing a highly directional photosensor deep inside 
the barrelof gun controller 48 and, with that sensor, de- 
tecting the spot on home-use TV receiver 40, the time 
from the instant of starting the scan to the instant of de- 
tecting the spot is calculated and, from that, the position 

20 (coordinates) of the spot on the screen of home-use TV 
receiver 40 is calculated. Then, by inputting that posi- 
tion, in other words the direction of the gun barrel into 
home-use game machine 46, gun controller 48 can be 
suitably achieved. Note that it is best if the instant of 

25 starting the scan is obtained from a synchronization sig- 
nal included in the video signal supplied from home-use 
game machine 46 to home-use TV receiver 40. 
[0017] Then, calculation of the trajectories of bullets 
shot by the player through the game space of the screen 

30 of TV receiver 40 is performed in order; nd preferably, 
for each calculation, by displaying the bullet in the scene 
or by a like means, it can be judged whether an enemy 
character in the scene has been hit or not. The decision 
as to whether or not there has been a hit is made by 

35 finding a coordinate match, or a substantial coorasnate 
match, between the results of successive bullet trajec- 
tory calculations and enemy character position coordi- 
nates. 

[0018] Audio processor 20 is configured including a 

40 sound buffer, and data such as music, game sound ef- 
fects, etc., which have been read out from DVD 25 and 
stored in the sound buffer are played back and outputted 
from speaker 22. DVD playback part 24, in accordance 
with instructions from microprocessor 14, reads out 

45 game programs and game data stored in DVD 25. Pe- 
ripheral device interface 31 is an interface for connect- 
ing various peripheral devices to home-use game ma- 
chine 46 and can use a USB (Universal Serial Bus) in- 
terface, for example. In this case, camera unit 42 is con - 

50 nected to peripheral device interface 31 . Camera unit 
42 is, for example, a commonly known digital camera 
for inputting gray scale photographic images (256 gra- 
dations of black and white) into home-use game ma- 
chine 46 at specified time intervals (for example, every 

55 i/60 th of a second, etc.) In the present case, in order to 
image capture the stance of player P, this camera unit 
42 is mounted on top of home-use TV receiver 40 in the 
state where its lens is pointed at player P. 
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[001 9] Here will be explained the processing done by 
home-use game machine 46 for displaying the title 
screen. This processing is executed based on the game 
program stored in DVD 25. 

[0020] Fig. 3 is a diagram showing the software con- 
figuration of the microprocessor 14. In Fig. 3, microproc- 
essor 14 comprises initial play position setup part 70, 
position recognizing part 71 , filter processing part 72 
and viewpoint change processor 73. The functions of 
each part are performed based on the game program 
stored in DVD 25. Position recognizing part 71 compris- 
es the several parts from image capture control part 
7111 to center of gravity calculating part 7123. Filter 
processing part 72 comprises the several parts from in- 
formation updating part 7211 to buffer size determining 
part 7214. 

[0021] Initial play position setup part 70 is a means 
for performing initial calibration processing to normalize 
the player's standing position. Thus, as shown in Fig. 6, 
in a specified position on monitor 18, it displays "player 
standing position guide image" 50 and in a specified po- 
sition in that image 50, which in the present embodiment 
is slightly above the center, it displays "head reference 
position marker" 52 shown, for example, by a circular 
marker. It also displays, superimposed on the above im- 
age, player image 56 , image-captured by camera unit 
42, and "present recognized position marker" 54, ob- 
tained from that image 56 and shown, for example, as 
a round dot By changing the standing position orstance 
of player P, or the photographing direction or photo- 
graphing position of camera unit 2, present recognized 
position marker 54 moves into circularly-shaped head 
reference position marker 52. Whereupon the display 
appearance of head reference position marker 52 is 
changed (for example, turning ON or OFF a colored or 
flashing display) indicating that the reference position 
(initial play position) has been normalized. 
[0022] Next, in Figs. 4A through D, is shown a series 
of game scenes displayed on home-use TV receiver 40 
for the case that player P's head moves in an up-down 
direction. In Figs. 4A through 4D of the same figure, four 
scenes are shown in the order of their display for the 
case that player P, in front of camera unit 42, rises from 
a crouched stance gradually to an almost fully upright 
stance-in other words, for the case that player P's head 
moves from a lower position to a higher one. In the game 
scene shown in Fig. 4A of the same figure, table-shaped 
barrier B exists immediately in front of the viewpoint, ex- 
pressing the situation that player P is hiding in front of 
the lower part of this barrier B. In this case, only a part 
of the head of enemy character AC1 , who is behind bar- 
rier B holding a gun in his hand : appears in the game 
scene. Next, the game scene shown in Fig. 4B of the 
same figure shows the situation where player P has 
raised his head a small amount, so that the level of his 
head is about the same as that of the upper surface of 
barrier B. In this case, enemy character AC1 becomes 
visible down to his chest while behind him the heads of 



two more enemy characters, AC2 and AC3, newly ap- 
pear in the game scene. The game scene shown in Fig. 
4C of the same figure shows the situation where player 
P has straightened up more and raised his head. In this 
5 case, player P's head is in a slightly higher position in 
the game scene than the barrier upper surface Bs. The 
upper bodies of the three enemy characters, AC1 
through AC3, are visible and the barrier upper surface 
Bs also appears. The game scene shown in Fig. 4D of 
w the same figure shows the situation where player P is 
essentially in a fully upright stance. In this case, the head 
and shoulders of player P are exposed above barrier B 
and barrier upper surface Bs is visible to a greater extent 
than in the game scene shown in Fig. 4C of the same 
15 figure. As shown in these figures, as the position of play- 
er P's head rises, the display position of barrier B moves 
lower, and a more complete view of barrier upper sur- 
face Bs and enemy characters AC1 through AC3 grad- 
ually appears in the game scene. 
20 [0023] Next, Figs. 5A through 5D show an example of 
a series of game scenes displayed on home-use TV re- 
ceiver 40 in the case that player P's head moves in a 
right-left direction. In Figs. 5A through 5D of the same 
figure, four scenes are shown in the order of their display 
25 for the case that player P, in front of camera unit 42, 
moves his body from the right side to the left side, in 
other words, for the case that player P's head moves 
from the right side to the left side. In the game scene 
shown in Fig. 5A of the same figure, door- or wall- 
30 shaped barrier B exists immediately in front and at the 
right side of the viewpoint, expressing the situation that 
player P is hiding in front of this barrier B. In this case, 
only a part of the arm of enemy character AC1 , who is 
behind barrier B holding a gun in his hand, appears in 
35 the game scene. Next, the game scene shown in Fig. 
5B of the same figure shows the situation where player 
P has moved to the left somewhat, so that his head is 
about even with left edge of barrier B. In this case, the 
head and chest of enemy character AC1 become visible 
40 in the game scene. The game scene shown in Fig. 5C 
of the same figure shows the situation where player P 
has moved further to the left. The upper body of enemy 
character AC1 becomes visible and enemy character 
AC2 also appears behind him. The game scene shown 
45 in Fig. 5D of the same figure shows the situation where 
player P is essentially in a fully upright stance. In this 
case, player P has jumped out to the left from barrier B 
and, in addition to enemy game characters AC1 and 
AC2, enemy game character AC3 has additionally ap- 
se peared. 

[0024] As shown in these figures, as the position of 
player P's head moves from left to right, the display po- 
sition of barrier B moves to the right side and corre- 
spondingly the display position of barrier B moves to the 
55 right and full views of enemy characters AC1 through 
AC3 gradually appear. 

[0025] Fig. 6 is a diagram showing an example of the 
game title screen (start screen) supplied by home-use 
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game machine 46. The title screen shown in the same 
figure is displayed on home-use TV receiver 40 after 
start up of home-use game machine 46 or after game 
completion and before the start of a new game. As 
shown in the same figure, on both sides of the screen 
in this title screen, images of menu buttons are dis- 
played and in the upper part of the center, game title text 
line 60 is displayed. In addition, under title text line 60, 
player "standing position guide image" 50 is displayed. 
In addition, menu buttons 62 are objects to be operated 
to select various games or set options, and when player 
P, by means of controller 48 shoots menu button image 
62, the game or option setting corresponding to that 
menu button image 62 is started. 
[0026] Player "standing position guide image" 50 is 
displayed by means of initial play position setup part 70 
and is an image for assisting player to normalize his 
standing position priorto game start. Priorto start of the 
game, player P, looking at this same "standing position 
guide image" 50, corrects his standing position or 
stance in front of camera unit 42 or corrects the picture- 
taking angle or position of camera unit 42. Initial play 
position setup part 70, based on real-time images ac- 
quired by camera unit 42 from image capture controller 
7111 , in other words, based on player image 56 : aligns 
and displays head reference position marker 52 and 
present recognized position marker 54. Head reference 
position marker 52 is a circular mark displayed in a fixed 
position of player image 56 (for example in the center of 
player image 56 at a position 1 5% from the top, etc.) Its 
purpose is to show the location in player image 56 where 
the image position of player P's head (top part of his 
head) should be aligned, priorto start of the game. Like- 
wise, with this game apparatus 10, it is arranged that 
the present position of player P's head can be recog- 
nized from player image 56 and the circular dot indicat- 
ing that recognized position is displayed superimposed 
as "present recognized position marker" 54 on player 
image 56. Player P, by moving his own body (standing 
position or stance) or changing the picture-taking direc- 
tion or position of camera unit 42, can make present rec- 
ognized position marker 54 move into circular head ref- 
erence position marker 52. Initial play position setup part 
70 determines whether present recognized position 
marker 54 is displayed inside head reference position 
marker 52. It is made so that, depending on that result, 
it changes the display appearance of head reference po- 
sition marker 52 (for example, turning ON or OFF a color 
or flashing display). In this way, it is arranged that player 
P, while viewing player standing position guiding image 
50, can readily normalize the positional relationship of 
himself and camera unit 42, prior to start of the game. 
[0027] Here is explained the processing of home-use 
game machine 46 for displaying the title screen. This 
processing is performed based on the game program 
which has been stored in DVD 25. 
[0028] Fig. 7 is a flow diagram describing game title 
screen display processing by home-use game machine 



46. As shown in the same figure, with home-use game 
machine 46, first, microprocessor 14 plots the back- 
ground image of the title screen, title text line 60, menu 
button images 62, copyright indication, etc. into VRAM 

5 which is included in image processor 16 (S101). Next, 
the image to be captured by camera unit 42 (here, the 
object is to photograph player P, so this is called a "play- 
er image") is captured (S102). Then, the player image 
captured in S102 is plotted into VRAM (S103), so that 

10 the player image is positioned in the "player standing 
position guide image" 50 position in the title screen. 
[0029] Further, based on the player image captured 
in S102, the position of player P's head (head position) 
is recognized and information after filter processing the 

15 recognition results (filter processed head position) is ac- 
quired (S104). The position recognition processing and 
fitter processing mentioned here will be explained in de- 
tail later. Afterward, microprocessor 14 draws the 
"present recognized position marker" 54 at the VRAM 

20 coordinates corresponding to the filter processed head 
position (S1 05), so that a marker (red point) is displayed 
at head position of the player image included in the title 
screen. 

[0030] Next, initial play position setup part 70 deter- 
25 mines whether the filter processed head position is in 
the reference position. The reference position is the po- 
sition in the player image where player P's head should 
appear prior to start of the game. Then, if the filter proc- 
essed head position is in the reference position, a red- 
30 colored head reference position marker 52 is plotted at 
the reference position of the player image already plot- 
ted in the VRAM (S1 07). On the other hand, if the filter 
processed head position is not in the reference position, 
a blue-colored head reference position marker 52 is 
35 plotted at the reference position of the player image 
(S108). Afterward, the gun barrel direction of gun con- 
troller 48 is acquired (S1 09), and aiming marker is 58 is 
drawn in that position (S110). 

[0031] If the above is done, in the case that the posi- 

40 tional relationship between player P and camera unit 42 
is not appropriate, as shown in Fig. 8, "present recog- 
nized position" marker 54 will be displayed outside cir- 
cular head reference position marker 52 in the title 
screen and head reference position marker 52 will be 

45 displayed in blue. On the other hand, in the case that 
the positional relationship between player P and camera 
unit 42 is appropriate, as shown in Fig. 6 : "present rec- 
ognized position" marker 54 will be displayed inside cir- 
cular head reference position marker 52 in the title 

50 screen and head reference position marker 52 will be 
displayed in red. In this way, by changing his standing 
position or changing the mounting position or camera- 
direction of camera unit 42, so that head reference po- 
sition marker 52 is made to be displayed in red in the 

55 title screen, player P can readily normalize the positional 
relationship between himself and camera unit 42. 
[0032] If the positional relationship between player P 
and camera unit 42 is not normalized, when player P 
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bends, stoops or shifts his body right or left during the 
game, his head position may not fit into the player image 
with the result that the correct head position could not 
be recognized. However, with present game apparatus 
10, the positional relationship of player P and camera 
unit 42 can be normalized prior to start of the game. As 
a result, even when player P bends, stoops or shifts his 
body left or right during the game, his head position can 
be correctly recognized. 

[0033] Note that the guidance given to player P need 
not be limited to that explained above. For example, as 
in the guidance image shown in Fig. 9, it is acceptable 
to display only present recognized position marker 54 
and head reference position marker 52, without display- 
ing the player imago In addition, instead of changing 
the display appearance of head reference position 
marker 52 according lo the positional relationship of 
present recognized position marker 54 and head refer- 
ence position markc 52 it is ricccp:abk? lo change the 
display appearance o? piosent recognized position 
marker 54 (color or Hashing pattern) Alternatively, it is 
acceptable to provide a display m a separate location, 
responsive to the positional relationship of present rec- 
ognized position marker 54 and head reference position 
marker 52. It is also acceptaolo to omit display of the 
present recognized position marker 54. 
[0034] Furthermore, it is also acceptable to display 
only present recognized position marker 54 and to 
change the display appearance of present recognized 
position marker 54 when present recognized position 
marker 54 moves into the position where head reference 
position marker 52 should properly be displayed. Even 
if this approach is taken, player P can correct the posi- 
tional relationship between himself and camera unit 42 
while watching the guidance image. 
[0035] In addition it is acceptable if the arrangement 
is that, according to the relationship between the 
present recognized position of player P's head and the 
reference position, a message, for example "Please 
move to the right," or"Please move to the left" or"Please 
move forward," or "Please move backward," is dis- 
played. Also, the shapes of present recognized position 
marker 54 and head reference position marker 52 are 
not limited to those described above, but a variety of 
kinds of shapes can be adopted. Furthermore, the guid- 
ance for player P can be provided prior to start of the 
game. To do that, the guidance for player P may be pro- 
vided, for example, on a different screen from the title 
screen. 

[0036] Next will be explained player image processing 
in home player game machine 46. 
[0037] Fig. 10 is a flow chart which describes the 
processing which, based on the player image acquired 
from camera unit 42, subject to control by the image cap- 
ture control part, recognizes the head position of player 
P and performs filtering of the recognition results. Like- 
wise, Fig. 1 1 is a flow chart which describes the filter 
processing in detail. In accordance with the game pro- 
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* gram stored in DVD 25, the various processing is exe- 
cuted in home-use game machine 46, at specified time 
intervals (for example, every 1 /60 th of a second) as con- 
trolled by timer 7112. 
5 [0038] When the player image has been acquired by 
camera unit 42, captured image fetching part 7113, as 
shown in Fig. 1 0, first stores that player image in an im- 
age buffer prepared in main memory 26 (S201). This 
image buffer is for the purpose of storing in memory the 

10 images acquired by camera unit 42 at specified time in- 
tervals. It stores in time sequence, a specified number 
of (here, a total of 4) player images, including the newest 
player image. Then, when the newest player image is 
acquired, that player image is added to the image buffer 

15 and at the same time the oldest player image is discard- 
ed. Fig. 12 is a diagram showing a series of player im- 
ages stored in the image buffer. In the sub-figures of Fig. 
12, the following are shown: in Fig. 12A of that figure, 
the newest player image; in Fig. 1 2B of the same figure, 

20 the preceding player image; in Fig. 1 2C of the same fig- 
ure, the player image preceding that one; and in Fig. 
1 2D of the same figure, the player image even preced- 
ing that one (that is, the oldest player image in the buff- 
er). The example shown in that figure shows the situa- 

25 tion where player P sways his body from left to right in 
front of camera unit 42. 

[0039] Next, averaging processor 71 1 4 generates an 
average of the three player images which are the player 
images stored in the image buffer excepting the newest 

30 image (S202). In this embodiment, the averaged image 
is an image obtained by averaging the color information 
(256 monochrome gradations) given to each picture el- 
ement [pixel] corresponding to the three player images. 
As will be explained later, this number, 3, has been found 

35 to be suitable experientially and experimentally, based 
on the movement of player P and the image-fetching pe- 
riod of 1 /60 th of a second. Then , by means of first differ- 
entiator/binary converter 7115, the difference between 
this averaged image and the newest player image is 

40 generated (S203). This differential image is the image 
obtained by subtracting the color information given to 
the corresponding pixels in these two images, magni- 
tude-comparing it to a threshold value, and converting 
it to binary (to monochrome). Fig. 13 is one example of 

45 this differential image. Then , by means of image extrac- 
tor 7116, an image with a specified radius centered on 
the previous recognized position (the position of player 
P's head) is extracted from this differential image 
(S204). Fig. 14 is an example of this extracted image. 

so in this drawing, the black dot shows the previous recog- 
nized position and in fact, it is not shown in the extracted 
image. 

[0040] Next, area determining part 7117 checks 
whether or not the area of the region shown in black in 
55 the extracted image (the region where a difference re- 
mains) is below a specified threshold or not (S205). 
Then, if the area of the region shown in black in the ex- 
tracted image is below the specified threshold, re-out- 
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putting part 7118 re-outputs the previous output (filter 
processed head position) which has been stored ahead 
of time in main memory 26 (S21 3). In the case that play- 
er P's amount of movement is small, as shown in Fig. 
15, only a differential part corresponding to player P's 
outline remains as the differential image obtained in 
S203. In this case, by extracting the neighborhood of 
the previous recognized position, that area becomes 
small, as shown in Fig. 16. In the processing from S202 
to S205, when, as shown in Fig. 16, the amount of move- 
ment is small, the previous output is re-outputted and 
changing of the output value is suppressed. 
[0041] On the other hand, in the case that the area 
shown in black in the extracted image exceeds a certain 
threshold, next the newest player image (in Fig. 12A) 
and the player image immediately preceding that (in Fig. 
12B) are read out of the image buffer, and a differential 
image of them (image converted to binary) is generated 
(S206) by means of second differentiator/binary con- 
verter 7119. Fig. 17 is a diagram showing one example 
of this differential image. Then, from this differential im- 
age, image extractor 7116 extracts an image (the se- 
lected image) of a specified radius centered on the pre- 
viously recognized position. This specified radius may 
be the same as the previously described specified radi- 
us adopted for use in the decision-making of area de- 
termining part 71 1 7, or it may be set at a somewhat larg- 
er value, considering that the amount of motion may be 
large. Fig. 18 shows an example of this extracted image. 
In this figure, the black circular dot indicates the previous 
recognized position and it is not actually displayed in the 
extracted image. The position of the pixels shown in 
black in the extracted image is used in recognizing the 
head location of player P in S211. In other words, this 
extracted image includes the foundation position group 
at the time that head position of player P is recognized. 
Then, player head position is found from the foundation 
position group pixels. 

[0042] Change amount calculator 71 20 calculates the 
amount of change in the region shown in black in this 
extracted image (foundation position group; region 
where difference remains). According to the present 
embodiment, height and width are measured, and those 
values are respectively checked by change determining 
part 7121 as to whether or not they are under specified 
threshold values (S208). If it is found by change deter- 
mining part 71 21 that either of these values is below the 
specified threshold, the extracted range (selected 
range) is moved by image movement processor 71 22 in 
the direction of player P until the extracted range (se- 
lected range) is sufficiently close to player P (S209) and 
the extracted image is regenerated (S210). Specifically, 
the center of gravity of the region shown in black in the 
differential image of S206 (image converted to binary) 
is calculated by center of gravity calculator 71 23 and the 
center of the extracted range (selected range) is moved 
in specified distance increments from previous recog- 
nized position toward that center of gravity. Fig. 19 is a 



diagram for explaining the nature of that processing. In 
it, the region which has been hatch marked is the region 
where a difference remains and the black triangle indi- 
cates the position of the center of gravity of the differen- 

5 tial portion, while the black dot indicates the previous 
recognized position. The same figure shows the appear- 
ance of a sudden movement of player P from the upper 
left to the lower right in front of camera unit 42. In S21 0, 
in such a case, the center of the extracted range (se- 

10 lected range) is gradually moved from the position of the 
black spot in the same figure in the direction of the black 
triangle by means of image movement processor 71 22. 
Then, in the case that, even if it is moved a distance that 
is a specified fraction of the distance between the pre- 

15 vious recognized position and the center of gravity, for 
example, 70%, the region shown in black in the extract- 
ed image remains narrow, as before, the output of the 
previous time will be re-outputted (S213). On the other 
hand, if as a result of shifting the extracted range (se- 

20 lected range), both the height and width of the region 
shown in black in the extracted image come to exceed 
their respective specified threshold values, as shown in 
Fig. 20, the head position for this iteration is determined 
from the extracted image of that time (S211 ). For exam- 

25 pie, a position in the center of the region shown in black 
in the selected image and a few pixels down from the 
top is selected as the head position for this iteration. Af- 
terward, filter processing is performed on the head po- 
sition of this iteration, which was selected (recognized) 

30 in this way, and the head position after filter processing 
is outputted (S212). 

[0043] If the above approach is followed, as a general 
rule, a foundation position group is selected within the 
selected range corresponding to the recognized posi- 

35 tion of the previous time, and as an exception, the foun- 
dation position group is re-selected, changing the selec- 
tion range. Even in the case that in the player image a 
moving object other than the player is image-captured, 
its influence can be rejected and even in the case that 

40 the head position has moved particularly quickly, appro- 
priate position recognition can be done. 
[0044] Next, in the above-described filter processing, 
as shown in Fig. 21 A, a head position buffer is provided 
in main memory 26, and, by means of information up- 

45 dating part 7211, this buffer stores a maximum of 16 
head positions (Pn through Pn-15; where the appended 
characters correspond to the recognition time). This 
head position buffer is for storing the head positions of 
player P, recognized every specified time period, and in 

50 the buffer are stored in time sequence a maximum of 16 
head positions, including the newest head position. 
Then, when the newest head position is recognized, that 
head position is additionally stored in the head position 
buffer and, at the same time, the oldest head position is 

55 discarded. For example, in the situation of Fig. 21 A of 
the same figure, when head position Pn+1 is recog- 
nized, that head position Pn+1 is additionally stored in 
head position buffer and the oldest head position, Pn- 
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15 is discarded from the head position buffer. In addition, 
with this head position buffer, the buffer size (in other 
words, the number of stored head position "units") is var- 
iable. In the present embodiment, for example, as 
shown in Fig. 21 B of the same figure, the states of 2 
units : 4 units, and 8 units can be arranged, while as 
shown in Fig. 21 B of the same figure, the state of 16 
units can be arranged, thus providing atotal of four pos- 
sible storage states. 

[0045] As shown in Fig. 11 , with the filter processing, 
first, n [head positions] are acquired, equal to the current 
buffer size of the head position buffer (S301). Then, if 
current buffer size n is equal to the maximum size Nmax 
(here, 1 6) (S302), by means of information updating part 
7211, the oldest head position is discarded from the 
head position buffer, and the newest head position is 
additionally stored in the head position buffer (S305). 
On the other hand, if, as determined of buffer size de- 
termining part 721 4, the current buffer size n is not equal 
to maximum size Nmax, the oldest head position is not 
discarded, but the newest head position is additionally 
stored in the head position buffer (S303), and 1 is added 
to the current buffer size of n (S304). 
[0046] Next, the amount of movement of each head 
position stored in the head position buffer is calculated 
(S306). Specifically, by means of movement amount 
calculator 7212, the distance between each head posi- 
tion and the head position immediately preceding it is 
calculated. For example, in the example of Fig. 21 , the 
distance between head position Pn and head position 
Pn-1, the distance between head position Pn-1 and 
head position Pn-2, the distance between head position 
Pn-2 and head position Pn-3, .... and the distance be- 
tween head position Pn-1 4 and Pn-1 5 are calculated. 
(In the case that 1 6 pieces of data are not all there (for 
example, if some are discarded), it is performed with the 
available data.) In addition, movement amount calcula- 
tor 721 2 calculates an average of the calculated move- 
ment amounts and next, by means of buffer size deter- 
mining part 7213, buffer size N corresponding to that 
value is determined (S307). In the present embodiment, 
if the average value is 11 or more, the buffer size is set 
at N=2; if 9 or more, but under 11 , buffer size is set at 
N=4; if 7 or more, but under 9, buffer size is set at N=8; 
and, if under 7, buffer size is set at N=1 6. Note that here 
it has been arranged such that buffer size N is deter- 
mined based on the average of the movement amounts 
of the head positions stored in the head position buffer, 
but it would be acceptable to adopt another calculation 
method. For example, it would be acceptable if the 
movement amount of each head position were given 
weight, and the objects of movement amount calcula- 
tions were limited to comparatively new ones from 
among the head positions stored in the head position 
buffer. In this way, it could be arranged that, in cases 
where it is determined that the newest head position 
moved suddenly, buffer size N would immediately de- 
crease in size. 



[0047] Next, buffer size determining part 7214 com- 
pares the current buffer size n and buffer size N (S308). 
If current buffer size n is larger than buffer size N, head 
positions stored in the head position buffer are discard- 

5 ed in order from the oldest ones, so that current buffer 
size n becomes buffer size N (S309). On the other hand, 
if current buffer size n is equal to or less than N, S309 
is skipped. Afterward, the head positions stored in the 
head position buffer are averaged and those values are 

10 stored in main memory 26 as "previous output" (S311) 
and are outputted as filter processed head positions 
(S312). As explained above, the filter processed head 
positions are used in determining viewpoint position 
when a 3-dimesional space is plotted. In addition, they 

15 are used when determining the display position of 
present recognized position marker 54 when displaying 
player standing position guide image 50 in the title 
screen. Note that, here, the average value of head po- 
sitions stored in the head position buffer is considered 

20 to be the filter processed head position. However, it 
would also be acceptable to attach weight to the head 
positions stored in the head position buffer, for example 
making it such that the influence of the newest head po- 
sition in determining the filter processed head position 

25 would be greater. 

[0048] Because, through the above-described filter 
processing, it was made such that an average value of 
head positions stored in the head position buffer is out- 
putted, it is possible to suppress variation in the value 

30 of the filter processed head position. In addition, be- 
cause it was made such that the size of the head position 
buffer changes according to the movement amounts of 
the head positions stored in that head position buffer, in 
the case that the head position of player P moves sud- 

35 denly, the value of the filter processed head position can 
be made to change quickly in response to that. For that 
reason, it becomes possible to perform game process- 
ing advantageously using a filter processed head posi- 
tion. 

40 [0049] Then, the position information obtained by 
viewpoint change processor 73 is sent to image proc- 
essor 16. In this way, the viewpoint of a simulated cam- 
era in a simulated 3-dimensional space can be estab- 
lished in image processor 16, based on information in- 

45 putted as explained above, and display processing of 
images viewed from that viewpoint is accomplished. 
[0050] Note that the present invention is not limited to 
the above-described embodiments. 

so (1) For camera unit 42, two camera devices sepa- 
rated by a certain distance and placed so that their 
shooting directions cross each other (preferably 
crossing at a right angle) may be used. They should 
be arranged so that from their respective player im- 

55 ages , the two-dimensional movement of the marked 
region is calculated, with one camera (pointed in the 
same direction as monitor 18) capturing up/down 
and transverse movement, while the other camera 
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(pointed to cross the screen of monitor 1 8) is point- 
ed such that it acquires depthwise movement, rel- 
ative to monitor 18. By doing this, 3-dimensional 
player movement can be detected and it is possible 
to move the simulated camera viewpoint inward and 
outward, in addition to up/down and right/left. 

(2) In the present embodiment, for the game imag- 
es, images in a 3-dimensional space were used, but 
the present invention can also be applied to games 
played in 2-dimensional space, and in that case im- 
ages can be moved up/down or right/left in the 
screen. 

(3) In the above description an example was pre- 
sented in whch the present invention was applied 
to a gun shooting game, but it could be applied to 
any kind of game as lang as images are acquired 
by an image caotunng means and the game pro- 
ceeds based on those images 

(4) Here player Ps> henc whs used as the object 
whose position wa:> leccgni/cd. but another part 
may be used as the ooject of position recognition. 
Moreover, any object which player P holds in his 
hand, for example a toy golf club, a toy tennis rac- 
quet, or a toy gun. etc may be used as the object 
of position recognition 

[0051] In summary, the present invention relates to a 
video game apparatus including a display for displaying 
images; a display control means for creating game im- 
ages as seen from a simulated camera viewpoint and 
displaying said images on the screen of the display; and 
a game control part for conducting the game in response 
to reactions of a player responsive to the images dis- 
played on the display. The video game apparatus of this 
invention comprises: an image capture means which 
can be arranged in such an orientation that its field of 
view is the play area in front of the display screen, and 
which periodically captures an image of the play area in 
the state thus arranged; a position detecting means for 
detecting from the captured images the position of a 
player's marked region; a movement detecting means 
for detecting two-dimensional movement of the position 
of the marked region thus detected; and a viewpoint 
changing means for moving the simulated camera view- 
point, in conjunction with the change direction and 
change amount of the position of the detected marked 
region. 

[0052] The present invention takes another form. That 
is a method for controlling movement of a simulated 
camera viewpoint in a video game that is conducted by 
creating game images as seen from a simulated camera 
viewpoint, and displaying the images on the display 
while moving the simulated camera viewpoint in re- 
sponse to reactions of a player responsive to the images 
displayed on the display, the method comprising the 
steps of: while periodically capturing images of the play 
area by means of an image capturing means positioned 
in a desired position so that its orientation is such that 



its field of view is the play area in front of the display 
screen, detecting a player's marked region from these 
captured images; further detecting two-dimensional 
movement of the position of the marked region; and 

5 moving the simulated camera viewpoint in conjunction 
with the direction of change and amount of change of 
the position of the detected marked region. 
[0053] According to the aforementioned features, 
game images, for example 3-dimensional images, from 

10 the simulated camera viewpoint are created. These im- 
ages are displayed on the screen of a display and the 
game proceeds while the simulated camera viewpoint 
moves due to player response, for example change in 
player stance, as player responds to the images dis- 

15 played on above-mentioned display. In addition, images 
of the play area are periodically captured by means of 
an image capturing means positioned In a desired po- 
sition so that its orientation is such that Its field of view 
is the play area in front of the display screen. Then, from 

20 these captured images, the player's marked region for 
example his head, is detected and, additionally, two-di- 
mensional movement of the position of the above-men- 
tioned marked region is detected. The simulated cam- 
era viewpoint is moved so that above-mentioned simu- 

25 lated camera viewpoint points to the position of the de- 
tected marked region that is, it is linked to (made to fol- 
low) the direction of change and amount of change of 
the simulated camera. According to the invention de- 
scribed in the above, the image capture means can be 

30 readily mounted in a desired position relative to the dis- 
play, and images can be constructively presented from 
the player's intended viewpoint, as though the simulated 
camera viewpoint is made to follow the player's free 
movement. In this way, the scope of game play can be 

35 broadened and games can be provided which are rich 
in interest and realism. 

[0054] In the above described invention, the player's 
marked region can be the player's head. With this con- 
figuration, because the movement of the player's head, 

40 and thus his eyes, corresponds to the simulated camera 
viewpoint, movement of the viewpoint becomes realis- 
tic. As a result, because the viewpoint of the simulated 
camera and the movement of the player's head (that is, 
his eye position) can be matched, a more realistic view- 

45 point movement can be achieved. 

[0055] Furthermore, in the above invention, the oper- 
ational contents from a controller capable of external 
control can be to be reflected in the progress of the 
game. With this configuration, by conducting the game 

so content through operation of a control part, such as a 
model gun, functioning as a game controller, the game 
becomes one richer in content variation. With the afore- 
mentioned feature, game content is carried out through 
operation of a control part, such as a model gun, etc., 

55 functioning as a game controller, and games can be pro- 
vided which are richer in content variation. 
[0056] In addition, in the above invention, it may be 
possible that the image captu re means includes first and 
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second image capture means separated by a specified 
distance and arranged so that their directions intersect, 
and 3-dimensional movement of the player's marked re- 
gion is detected from player images obtained by the first 
and second image capture means. With this configura- 
tion, because 3-dimensional movement of the player 
can be detected, it becomes possible to move the sim- 
ulated camera viewpoint in the inward-outward direction 
in addition to the up/down and transverse directions, 
and the effect is a more realistic performance, especially 
in cases where the game images are 3-dimensional. 
With the aforementioned feature, because player's 3-di- 
monsional movement can be detected, depthwise 
movement of the simulated camera viewpoint in addition 
to up'down and transverse movement (in other words, 
3-dimcnsioial movement) is possible. 
[0057] The present invention can take another form 
which is a recording medium which stores a program for 
having a computer execute the method for controlling 
movement of a simulated camera viewpoint in a video 
game as recited in the above descriptions. 
[0058] Although the present invention has been fully 
described by way of example with reference to the ac- 
companying drawings, it is to be understood that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless otherwise such 
changes and modifications depart from the scope of the 
present invention hereinafter defined, they should be 
construed as being included therein. 



Claims 

1 . In a video game apparatus including a display hav- 
ing a screen for displaying images, display control 
means for creating game images as seen from a 
simulated camera viewpoint and displaying said im- 
ages on the screen of said display; and a game con- 
trol part for conducting the game in response to re- 
actions of a player responsive to the images dis- 
played on said display; said video game apparatus 
comprising: 

image capture means which can be arranged 
in such an orientation that its field of view is a 
play area in front of the display screen, and said 
image capture means periodically captures an 
image of the play area in the state arranged; 
position detecting means for detecting from the 
captured images a position of a player's 
marked region; 

movement detecting means for detecting two- 
dimensional movement of said position of the 
marked region detected by said position detect- 
ing means; and 

viewpoint changing means for moving the sim- 
ulated camera viewpoint, in accordance with 
the change direction and change amount of the 



position of the detected marked region. 

2. A video game apparatus according to claim 1 , fur- 
ther comprising initial play position setup means for 

5 performing initial calibration processing to normal- 
ize the player's standing position. 

3. A video game apparatus according to claim 2, 
wherein said initial play position setup means dis- 

10 plays player standing position guide image on the 
screen and reference position region at a predeter- 
mined position in said player standing position 
guide image, and present position mark corre- 
sponding to a player's marked region , obtained from 

15 said position detecting means is superimposed on 
the player standing position guide image. 

4. A video game apparatus according to claim 3, 
wherein when said present position mark is within 

20 the reference position region, said reference posi- 
tion region is displayed in a color differently than the 
color thereof when the present position mark is out- 
side of the reference position region. 

25 5. The video game apparatus according to one of the 
preceding claims, wherein the player's marked re- 
gion is the player's head. 



30 



6. The video game apparatus according to any one of 
claims 1 to 5, wherein operational contents given 
by a controller capable of external control are re- 
flected in the progress of the game. 



7. The video game apparatus according to any one of 
35 claims 1 to 6, wherein the image capture means 

comprises first and second image capture means 
separated by a specified distance and arranged so 
that their directions intersect so that 3-dimensional 
movement of the player's marked region is detected 
40 from player images obtained by the first and second 
image capture means. 

8. The video game apparatus according to one of the 
preceding claims, wherein said image capture 

45 means is formed in such a manner that it can be 
mounted on a desired position with respect to the 
display. 

9. A method for controlling movement of a simulated 
so camera viewpoint in a video game that is conducted 

by creating game images as seen from a simulated 
camera viewpoint, and displaying the images on 
said display while moving the simulated camera 
viewpoint in response to reactions of a player re- 
55 sponsive to the images displayed on the display, 
said method comprising the steps of : 

while periodically capturing images of the play 
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area by means of an image capturing means 
positioned in a desired position so that its ori- 
entation is such that its field of view is a play 
area in front of the display screen, detecting a 
player's marked region from these captured im- 5 
ages; 

detecting two-dimensional movement of the 
position of the marked region; and 
moving said simulated camera viewpoint in ac- 
cordance with the direction of change and 10 
amount of change of the position of the detect- 
ed marked region. 

10. The method according to claim 9, wherein the play- 
er's marked region is the player's head. 15 

1 1 . The method according to claim 9 or 1 0, wherein op- 
erational contents given by a controller capable of 
external control are reflected in the progress of the 
game. 20 

12. The method according to any of claims 9 through 
11, wherein the image capture means comprises 
first and second image capture means separated 

by a specified distance and arranged so that their 25 
directions intersect so that 3-dimensional move- 
ment of the player's marked region is detected from 
player images obtained by the first and second im- 
age capture means. 

30 

13. A recording medium storing a program for control- 
ling movement of a simulated camera viewpoint in 
a video game that is conducted by creating game 
images as seen from a simulated camera viewpoint, 
and displaying the images on said display while 35 
moving the simulated camera viewpoint in response 

to reactions of a player responsive to the images 
displayed on the display, said program comprising 
the steps of: 

40 

while periodically capturing images of the play 
area by means of an image capturing means 
positioned in a desired position so that its ori- 
entation is such that its field of view is a play 
area in front of the display screen, detecting a «5 
player's marked region from these captured im- 
ages; 

detecting two-dimensional movement of the 
position of the marked region; and 
moving said simulated camera viewpoint in ac- so 
cordance with the direction of change and 
amount of change of the position of the detect- 
ed marked region. 
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prises display 40 for displaying an image; image- 
processing means 16 for creating a 3-dimensional im- 
age from the viewpoint of a simulated camera and dis- 
playing that image on a display screen; and game con- 
troller 14 which conducts the game in response to reac- 
tions of the player, responsive to images displayed on 
display 40. The game apparatus further comprises cam- 
era unit 42 which can be arranged in such an orientation 
that its field of view is the play area in front of the display 
screen, and which periodically captures images of the 
play area in the state thus arranged; a position recog- 
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tured image, and detects the two-dimensional move- 
ment of the detected head position; and viewpoint 
change processor which moves the viewpoint of said 
simulated camera in conjunction with the change direc- 
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